Heat capacity in nonequilibrium steady states 
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We show how to extend the concept of heat capacity to nonequilibrium systems. 
The main idea is to consider the excess heat released by an already dissipative sys- 
tem when slowly changing the environment temperature. We take the framework of 
Markov jump processes to embed the specific physics of small driven systems and we 
demonstrate that heat capacities can be consistently defined in the quasistatic limit. 
Away from thermal equilibrium, an additional term appears to the usual energy- 
temperature response at constant volume, explicitly in terms of the excess work. In 
linear order around an equilibrium dynamics that extra term is an energy-driving re- 
sponse and it is entirely determined from local detailed balance. Examples illustrate 
how the steady heat capacity can become negative when far from equilibrium. 
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I. INTRODUCTION 

The study of thermophysical properties of materials has played a major role in the de- 
velopment of thermodynamics and physics in general. A key issue is to understand how the 
system responds to variations in external control fields via heat exchange with its environ- 
ment. The discussion simplifies for reversible thermal processes that are slow enough and 
pass through a sequence of equilibrium states. The heat exchange along such a process is 
determined by the way the system accommodates to the modified external conditions and 
relaxes to the new equilibrium state. Restricting to processes parameterized by temperature 
while other parameters (like volume, pressure etc.) are fixed, leads to the notion of heat 
capacity as a primary quantifier of the heat exchange. Their determination and charac- 
terization has proven very relevant in a great variety of domains ranging from industrial 
applications, over the study of phase transitions to fundamental tests for understanding 
the relation between mechanics and thermodynamics. Not surprisingly they were also key 
objects of study in the beginnings of quantum theory, in the further development of solid 
state physics and in the thermodynamics of new materials. 

There is no well-established nonequilibrium theory. So far, the study of nonequilibrium 
heat capacities and related quantities has been mostly restricted to transient systems. 
There, internal relaxation is slow compared to the time-dependent control fields, with glassy 
systems as a paradigmatic example. A standard approach to transient systems involves 
frequency-dependent heat capacities as analyzed in several theoretical and experimental 
studies [1, 2]. In contrast, the present letter considers systems that are well relaxed but 
under stationary nonequilibrium conditions. The study of heat capacities for such systems 
is largely unexplored. Such studies would include the thermal conditions of active matter; 
it would ask for heat capacities of bodies in which life processes take place, and it would 
seem to require nonequilibrium extensions of thermodynamic potentials. These questions 
are probably too difficult and too broad to answer at once, but nevertheless they motivate 
us in the initial set-up and in our modeling. A central issue is then whether and how the 
steady nonequilibrium functioning produces substantial deviations from the equilibrium 
heat capacity, not because the system has not fully relaxed but because of a totally different 
physics altogether. 
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Preliminary calculations of steady state heat capacities within the framework of linear 
irreversible thermodynamics to explain certain involved conduction calorimetry experiments 
have been reported since almost twenty years [3]. We follow here more closely the ideas 
that were developed more recently in [4-7], which is sometimes referred to as steady state 
thermodynamics. 

To be specific, we mostly stick to a discrete set-up with a driven stochastic dynamics 
that is consistent with the presumed microscopic reversibility via the principle of local 
detailed balance and which covers a wide range of physically relevant nonequilibrium 
processes. As an example, we discuss at the end a model of driven diffusion in one and two 
dimensions, that naturally fits our formalism via the continuous (diffusion) limit of discrete 
approximations. 



We have in mind small thermodynamically-open systems on which mechanical work is 
performed and which are coupled to an environment represented by a single heat bath. A 
crucial physical hypothesis is that the external forces are not fully conservative so that the 
system is always dissipative. Our aim is to analyze to what extent the heat exchanged with 
the bath while slowly changing its temperature can be represented by a well defined heat 
capacity. 

To be specific, we consider Markovian dynamics with discrete states x,y, . . . representing 
distinct (mesoscopic) configurations of the system. It is a stochastic process with trajectories 
over a time- interval [0, r] written as 



each specified by a sequence of random jumps between states. Each state x is given an 
energy E{x) representing all conservative forces acting on the system. The non- conservative 
forces need to be introduced via the amount of work F(x,y) = —F(y,x) they perform 
on the system when it jumps from state x to y. Here we mostly assume that the energy 
function E{x) and the non-conservative work function F(x,y) are constant in time and 
we concentrate on the thermodynamic process corresponding to (slow) changes in the bath 



II. NONEQUILIBRIUM MODEL 





(1) 
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temperature T(t). (For F = this would lead to the heat capacity at constant volume.) 
Energy conservation on the level of a single trajectory [x t ], < t < r, can be written as 

E(x T ) - E(x ) = W F ([x t }) + Q([x t ]) (2) 

Here the change of energy is decomposed into the work of the non-conservative forces, Wp, 
and the heat Q flowing into the system. The work of conservative forces is zero by our 
assumption that E(x) does not explicitly depend on time. The work of non- conservative 
forces is 

n 

w F {[x t \) = Y,n^\^) (3) 

with the sum over all jump times in the trajectory (1). Since F does not derive from 
a potential, the work Wf remains a non-trivial trajectory-dependent function which is 
r— extensive for typical paths; the same being true for the heat Q for which the balance 
relation (2) serves as a definition. 

The dynamics is determined by transition rates A /3 (x, y) that are time-dependent through 
their explicit dependence on the inverse temperature (3 = 1/T (setting the Boltzmann con- 
stant to unity), 

\P(X, y) = ^( X , y) e l [E(x)-E(y)+F(x,y)] (4) 

By the condition of local detailed balance (expressing thermal equilibrium in the coupled 
heat bath, see [8]), the symmetry condition ipP(x,y) = ^(y,x) has to be always satisfied. 
If we now vary the temperature in time, the time-dependent distribution pt(x) solves the 
Master equation 

pt{x) = J2[pt(y)^ m (y,x)- Pt (x)x^(x,y)} (5) 

y 

We assume that for a fixed inverse temperature j3 the stationary distribution (f is unique and 
approached exponentially fast with relaxation time tr, the latter provides a reference time- 
scale to delineate the quasistatic regime. Expectations with respect to p 13 will be denoted 

by (Y- 

An essential feature of our model is that its stationary regime is fundamentally different 
from equilibrium: despite the local detailed balance, one has ff(x) ^(x^y) ^ fft(y) \^{y,x) 
unless F derives from a potential. In particular, the system exhibits steady dissipation, the 
rate of which is given by the (positive) mean stationary work (or equally heat) per unit 
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time (w 13 )^, the expectation value of w l3 (x) = ^2 ^( x , u) F(x, y) which is the expected 
power of the non-conservative forces when the system is in state x. Note that we allow the 
transition rates to depend on time only via their temperature-dependence — this condition 
will simplify the construction of the quasistatic limit. 

III. STEADY HEAT CAPACITY 

We come to our main question: Under what conditions and in what sense can some 
averaged heat (Q) along a process corresponding to T(t), < t < r, be given the form 
J Cp dT, with Cp an appropriate heat capacity? This can only be true provided that (Q) is 
'geometric' in the sense that it only depends on the values of temperature and not on how 
fast T changes in time. Such a property is known to hold for currents in the quasistatic 
limit of infinitely slow process [9], irrespective of being in or out of equilibrium. However, 
the essential difference between the equilibrium and the nonequilibrium cases is that in the 
latter there are non-zero stationary (sometimes called 'house-keeping') currents which are 
due to the intrinsic dissipation of the nonequilibrium steady states. These non-geometric 
currents need to be regularized away to separate the excess currents that are to be seen as 
a natural extension of the equilibrium energy changes. 

Next we explain in detail how this can be applied to construct the steady heat capacity 
in a consistent way. We more closely follow the formalism of Ref. [7] using the terms 
'house-keeping heat' and the 'excess heat' for the stationary and the geometric components, 
respectively. 

On a somewhat intuitive level, the thermodynamic process induced by changing f3(t), 
< t < r, can be considered to be quasistatic provided that the whole time interval can be 
suitably discretized, r = NAt, so that (1) At 3> tr (relaxation time), and (2) \A/3\//3 <C 1 
over all elementary time-intervals. Whenever r 3> r R , such a discretization is possible and 
we can see the whole process as essentially consisting of a sequence of N sudden and small 
temperature changes A/3 = 0(1/N), each one followed by relaxation to the new steady 
conditions. 

Within the k— th time interval [r fe _!,r fc ] — [k — l,k]Ar, the system can be thought to 
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relax to the steady state distribution p^ Tk \ starting at time T k -i from the steady distribution 
pP(Tk-i) reached in the previous interval. Up to leading order, the initial distribution can be 
given in terms of the final steady distribution as 

f M = f {Tk) - ^ W k ) - /3(t*_!)] + 0(N- 2 ) (6) 

while the expected work of the non-conservative forces within the relaxation process equals 

A k w F = r j2p*( x ) wm ( x ) dt ( 7 ) 

Jtu-x x 

where w^\x) = J2 y X^(x,y) F(x,y) is the expected power at time t provided the system 
is in state x. Approximating within the entire interval [r^-i, T k ] by w^ Tk \ we rewrite (7) 
up to corrections 0(N~ 2 ) in the form 

A k W F = ArJ2^ iTk) ( x ) w ^ Tk) ( x ) + [ " [Pt( x )-f iTk) ( x )] w p{Tk \x)dt (8) 
x Jn-i x 

The first term on the right-hand side of this equation is the house-keeping part of the work. 
It corresponds to the expected work if the system would be in its stationary state at every 
instant of time. The other term corresponds to the excess work. By assumption, At ^> tr 
and hence the system does reach the stationary state pP( tk \ which means that we can as well 
take the upper limit of the integral to be +oo. Formally solving the Master equation (5) 
to find p t and after some standard manipulation, we obtain the total quasistatic work of 
non-conservative forces by summing over k: 



with 

(w 



the steady rate of dissipation, given in the standard 'force times current' form. The first 
term in (9) is therefore the steady state (or 'house-keeping') component. The second term 
on the other hand relates to the transient (or 'excess') component where we have introduced 

POO 

V?{x)= / [(w^x t )) xo=x -(w^}dt (11) 



The state function V^(x) is to be understood as the transient part of the mean dissipated 



work along the complete relaxation path started from state x. The function {w^{x t )) 



XQ=X 
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yields the expected power at time t given that the system was started in state x at time 
zero. Note that (w^(x t )) xo=x ~ (w p ) fi for times t > t r , and (\/ /3 ) /3 = 0. 

In the same quasistatic regime where the system essentially passes through a succession 
of steady states, the expected change in energy is (E(x T ) — E(xq)) — f JL (E) 13 d[3. Hence, 
from the First Law (2), (Q) = - £ (w^Y^ dt + (Q) ex + 0{t r /t) with the excess heat 
{Q) ex = f Cp d(l//3) given in terms of the generalized heat capacity 



This is our main result. The first term resembles the familiar equilibrium expression for 
the heat capacity at constant volume (and/or other external parameters) but now under 
the nonequilibrium steady state. The second term is novel and it originates from the fact 
that even keeping all the external parameters and forces fixed and merely changing the 
temperature, there is an extra non-zero work done. Part of the energy which is added to 
the system can be used to change the stationary currents, reminiscent of the more familiar 
Mayer relation between the heat capacities at constant volume and pressure. In general, the 
function V"(x) non-trivially couples both variables (3 and x so that, without further condi- 
tions, the heat capacity cannot be written as the temperature derivative of some generalized 
thermodynamic potential such as in the construction of (equilibrium) enthalpy. 

The above derivation of formula (9) can easily be turned into a rigorous argument [14]: 
Using the quasistatic (or 'adiabatic') scaling of the time-dependent protocol, T(t) i->- T(et), 
t i — y s~ x t, both the work of non-conservative forces and the heat can be systematically 
expanded in powers of e. In this framework the house-keeping part is recognized as a 
linearly diverging term of order e~ l and the non- quasistatic corrections are 0(e). The 
excess work/heat are the finite (or 'renormalized') parts of both by construction diverging 
quantities. It is precisely in this sense that they can be considered as well-defined. 



It is crucial for the consistency of our construction that Cp is defined through excess heat 
that was proven to be geometric, i.e., fully determined by the steady state properties. In 
principle, both the steady rate of dissipation (w 13 ) 13 and the transient work functions V@(x) 




(12) 



IV. EXPERIMENTAL ACCESS 
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along relaxation paths can be obtained by measurement, independently of measuring the 
heat capacity from the quasistatic heat exchange. In this way a specific prediction is given 
concerning the mutual relation between the results of a priori different types of experiment. 

Clearly, the experimental accessibility of the generalized capacity strongly depends on 
whether the excess heat in the decomposition (Q) = — (w^)^ dt + (Q) ex + 0(tr/t) 
can be distinguished from the house-keeping (diverging) component — (w 13 ^) 13 ^ dt. A 
natural possibility comes from the different symmetry properties of the contributions: 
under the protocol reversal (3(t) h-> (3{t — t), the house-keeping part is symmetric whereas 
the excess part is antisymmetric; the residual non-quasistatic corrections have no definite 
protocol-reversal behavior. Hence, the excess heat along any path can in principle be 
extracted by repeatedly traveling the same temperature-path back and forth and counting 
in only differences in the heat exchanged or the work done. At the same time, the 
temperature changes need to be slow enough to avoid non-quasistatic residuals. Estimating 
the experimental errors with such a procedure probably remains a challenging but very 
relevant and physically interesting problem. 

Naturally, the same questions as discussed here in the context of stochastic systems can 
be addressed for macroscopic bodies under nonequilibrium conditions. A particular experi- 
mental setup has already been proposed in Ref. [3]: The authors there employ conduction 
calorimetry techniques to study the heat produced by a ferroelectric sample heated by 
an applied high-frequency AC-current. Changing the environment temperature results in 
modifications of the outgoing heat current that can be directly measured in real time by an 
imposed thermopile. It is argued that the method is subtle enough to distinguish the steady 
heat currents from their excess components which, after some time-integration, yield the 
heat capacity by definition. In this context, the present letter provides a general microscopic 
(or, more precisely, mesoscopic) theory for such a type of experiments on dissipative systems. 

V. LINEAR NONEQUILIBRIUM CORRECTION 

Some progress can be made in a close-to-equilibrium regime where we can control the 
steady-state properties of the system by a systematic expansion in the magnitude of the 
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nonequilibrium driving. In the pioneering work of McLennan [10], he found leading nonequi- 
librium corrections to the canonical distribution in terms of entropy changes; see also [11, 12] 
for recent extensions. Here we use the formulation and results of Ref. [13]. 

For small non-conservative forces F, the stationary distribution p 13 can be well approxi- 
mated by the McLennan ensemble, 

pP(x) ~ ^ exp [-0E(x) - PV^x)] (13) 

in which the correction term exactly coincides with the dissipated work along relaxation 
paths (11). This formula can be justified by scaling the driving forces as F(x, y) h-> eF(x, y) 
and expanding in powers of e; the McLennan distribution is proven correct up to order e. 

Up to linear order in F and by the construction of V*, the nonequilibrium term in (12) 
can be written in the form of equilibrium time-correlations between the energy and the 
power of the non-conservative forces : 

a poo 

C F ^-^—(Ef-p 2 j^ (E(x )w^x t ))^dt (14) 

Here the expectation (-)^ q is under the equilibrium distribution pf q (x) = exp [— j3E{x)]/Z^ 
and we have used that (w /3 )f q = 0. Finally, combining with the McLennan formula (13), we 
finally obtain the relation 

Cf^-P 2 ^(EY-P{(EY-(E)^) (15) 

always correct up to linear order in the nonequilibrium driving. Hence the close-to- 
equilibrium heat capacity consists of two linear-response contributions: (1) the (equilibrium- 
like) energy-temperature response and (2) the energy-driving response, which can be further 
rewritten in terms of an equilibrium correlation function like in the Green-Kubo relation. 
While the quasistatic heat capacity on the left-hand side of (15) derives from a thermody- 
namic process, the two response-functions on the right-hand side are by definition steady- 
state properties of the system. All three quantities in (15) are independently measurable, at 
least in principle. Note there is no dependence on the symmetric part ip? in the transition 
rates (4), which is at the origin of the remarkable simplification in the close-to-equilibrium 
regime. 

Remark that this linear order theory is only meaningful when the dynamics breaks 
the driving- reversal symmetry F >->■ — F (simultaneously for all transitions x ■<->■ y). 
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Under this symmetry, the linear nonequilibrium corrections to the heat capacity vanish, 
C eF = C + 0(e 2 ), due to the absence of the 0(e) corrections in both the mean energy 
(E)P and the transient work function V 13 . The higher-order corrections can be obtained by 
a systematic expansion in powers of the parameter e adopted to control the distance from 
equilibrium [12, 14]. 

The general non-perturbative formula (12) and its close-to-equilibrium approxima- 
tion (15) for driving-reversal asymmetric systems constitute the main results of this letter. 
In the next section we give specific examples that go beyond the scope of the simple linear 
theory and on which we demonstrate some peculiar features of the steady heat capacity (12). 



VI. EXAMPLE: DRIVEN DIFFUSION 

As a trial nonequilibrium system we consider the case of independent colloids driven in 
a toroidal trap, which is experimentally feasible [15]. The particle motion can be modeled 
by the overdamped driven diffusion on a circle of unit length, 

x t = F-E\x t ) + ^2T(t)ti t (16) 

(£t is standard white noise.) The driving force F is constant and, to be specific, we take 
the potential landscape E(x) = sin(27rx). The steady heat capacity C F is depicted in 
Fig. 1; we have evaluated (12) numerically exactly for a discrete-space approximation of the 
dynamics (16). For large temperatures the nonequilibrium correction to the steady heat 
capacity becomes dominated by the energy-temperature response (the first term in (12)) 
and Cp{T) asymptotically approaches the equilibrium curve C (T) = 1/(2T 2 ) + 0(T~ 3 ), for 
arbitrary forcing F. On the other hand, at lower temperatures the nonequilibrium correction 
becomes relevant and we see a qualitative change of behavior across the value F* = 2n, which 
we associate with the crossover between the limiting fixed point and the limiting cycle in 
the zero-temperature (deterministic) solution of (16). 

Our model demonstrates that C F can obtain negative values when far from equilibrium. 
Although similar observations concerning negative heat capacities have been made before 
for systems non- weakly coupled to finite reservoirs [16], here the physical origin is different 
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FIG. 1: Steady heat capacity Cp for driven one-dimensional diffusion. The trial potential landscape 
is E(x) = sin(27rx). 

and the effect emerges due to the nonequilibrium nature of our system; see more below. 

We also calculate the steady heat capacity at constant steady power, Cw, as defined via 
the excess heat along the quasistatic curve (T, F) on which the steady power (w /3 ) 13 remains 
constant. The general relation between both heat capacities is readily found to be 

x d{wf*y (d(w^\-Ud(U)P id a \h 



Cm — Cp + (3 



dF 



(17) 



d/3 \ dF 

with W and F related by the condition (w 13 ) 13 = W. For our diffusion model (16), the heat 
capacity Cw as a function of temperature is depicted in Fig. 2. 



To get a better understanding of how the steady heat capacity depends on the dissipa- 
tive properties of the system, we further consider the two-dimensional modification of the 
model (16), 

X t = F(X t ) - VE(X t ) + i t , X = (x,y) (18) 

with the spherically symmetric potential E(X) = | r 2 , A > and driven by the purely 
rotational field F(X) = K,r a eg with some a > — 1; the standard polar coordinates r and 9 
being used here. The conservative and the non-conservative fields are mutually orthogonal, 
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F ■ WE = 0, and the stationary density is insensitive to the nonequilibrium driving, p 13 = 
exp(-PE)/Z 13 , i.e., the same as if the system were in equilibrium. Hence, the first term in 
the steady heat capacity (12) equals unity by equipartition. However, different steady states 
are distinguished by their mean dissipative power that equals (w 13 ) 13 = F(a + 1) k 2 (2T/A) a . 
The nonequilibrium correction term in Cf can also be calculated analytically to yield the 
formula 

C - 1 4- 1 9{wr (19) 

This simple relation between the steady heat capacity and the mean power is not to be 
expected in general. Nevertheless, the relation makes it very clear that the steady heat 
capacity depends on how the dissipation, and not just the energy, depends on temperature. 
In our model the increase of temperature makes the steady states less localized around 
the origin and depending on whether a > or - 1 < a < 0, this corresponds to a higher, 
respectively lower amount of dissipation as quantified by the mean power (w 13 ) 13 . As a result, 
the nonequilibrium correction to the heat capacity obtains the same positive, respectively 
negative sign. This suggests that negative steady heat capacities may generally emerge for 
far-from-equilibrium systems when their steady dissipation decreases sufficiently strongly 
with temperature — details are left to further studies. We conclude our short analysis of 
this model by noting the equality Cw = Cf due to the F— independence of the stationary 
density p 13 , cf. formula (17). 



VII. CONCLUSION AND OPEN QUESTIONS 

We have analyzed a meaningful and consistent generalization of heat capacity to nonequi- 
librium systems. By applying and adapting the previously developed framework of slow 
transformations of nonequilibrium steady states, we have derived the basic properties of the 
heat capacity defined from the quasistatic heat. This construction makes physical sense 
because the finite excess part of the heat exchange is well-defined and geometric. In for- 
mula (12) a general non-perturbative expression for the steady heat capacity is given in 
terms of the (standard) energy-temperature response but modified with a new correction 
intimately related to the relaxation properties of the dissipative effects — the new term 
derives from the transient work of the driving forces along relaxation paths. 
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FIG. 2: Steady heat capacity Cm for the one-dimensional diffusion model. 

We have demonstrated via simple examples that the steady heat capacity can take neg- 
ative values as well. It has been argued that this phenomenon has to do with a specific 
temperature-dependence of dissipative characteristics far from equilibrium. The details of 
this proposal need to be further analyzed. Another relevant question is a detailed analysis 
of the steady heat capacity at low temperatures, in particular in regimes where the reference 
zero-temperature dynamical system is fundamentally different from the one in equilibrium. 
We expect the steady heat capacity and related nonequilibrium response functions to re- 
veal important information about the presence of nonequilibrium phase transitions in the 
system [17]. 

We have also found more specific expressions for the heat capacity of close-to-equilibrium 
systems breaking the driving-reversal symmetry. In that case the nonequilibrium contribu- 
tion to the heat capacity is directly related to the equilibrium linear response to switching 
on a (weak) nonequilibrium driving, see formula (15). Equivalently, it can be given in 
terms of equilibrium time- correlations resembling the Green-Kubo or fluctuation-dissipation 
relations. 

To conclude, remark that presently the inertial degrees of freedom (the particles' mo- 
menta) have been considered 'fast' with respect to 'slow' spatial configurations, in the usual 
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sense of time-scale separation. By this assumption, the distribution of momenta is always 
Maxwellian and the contribution to the total steady heat capacity follows the equipartition 
theorem as per momentum degree of freedom, in the exact same way as in equilibrium. 
This restriction is not essential and the momenta degrees of freedom with more general 
stationary distributions can easily be included in the theory. 
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